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Abstract 

We propose a definition for the entropy of capacities defined on lattices. Classical 
capacities are monotone set functions and can be seen as a generalization of proba- 
bility measures. Capacities on lattices address the general case where the family of 
subsets is not necessarily the Boolean lattice of all subsets. Our definition encom- 
passes the classical definition of Shannon for probability measures, as well as the 
entropy of Marichal defined for classical capacities. Some properties and examples 
are given. 
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1 Introduction 



The classical definition of Shannon for probability measures is at the core of 
information theory. Therefore, many attempts for defining an entropy for set 
functions more general than classical probability measures have been done, 
in particular for the so-called capacities jl] or fuzzy measures |21j . Roughly 
speaking, capacities are probability measures where the axiom of additivity 
has been replaced by a weaker one, monotonicity with respect to inclusion. 



First definitions of an entropy for a capacity were proposed independently and 
approximately at the same time by Yager [221123] and Marichal and Roubens 
[H|15|I16| . The idea of Yager was to compute the Shannon entropy of the Shap- 
ley value of a capacity. To make the discussion more precise, let us consider 
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a finite universal set A, and a capacity v defined on it. The Shapley value 
[20] is a notion coming from cooperative game theory, and can be seen as a 
probability distribution <fi over iV which represents the average contribution 
of each element i e A in the value of v, that is, v(SUi) — v(S), for all subsets 
S of N\i. A slightly different proposition was done by Marichal and Roubens 
|16j . just by changing the place of the function h(x) := —x logx. It turned out 
that this definition seemed to be the right one, with properties close to the 
classical Shannon entropy [19]. In particular, it is strictly increasing towards 
the capacity which maximizes entropy. An important result, due to Dukhovny 
[B], and also independently found by Kojadinovic et al. [T2] .showed that the 
definition of Marichal and Roubens could be written as the average of classical 
entropy along maximal chains of the Boolean lattice of subsets of A. 

In this paper, we consider yet more general functions than capacities, in the 
sense that the underlying system of sets may be not the whole collection of 
subsets of N, but only a part of it, provided that this collection forms a lattice. 
This is motivated partly by cooperative game theory, where A is the set of 
players, subsets are called coalitions, and the fact that all subsets may not 
belong to the set systems corresponds to the situation where some coalitions 
may be forbidden. This is considered for example by Faigle and Kern [7] (games 
with precedence constraints). Our approach will follow Dukhovny, in the sense 
that our basic material will be the maximal chains over the considered lattice, 
and we will try to make the least possible assumptions on the lattice in order 
that our construction works. This permits to consider our definition in a more 
abstract way, forgetting about the corresponding set system, and working 
only on the lattice. In this way, it is possible to consider as particular cases 
bi-cooperative games of Bilbao [21 Section 1.6], and multichoice games [TT] . 

Section 2 recalls classical facts on Shannon's entropy and the definition of 
Marichal and Roubens, Section 3 gives the necessary material for lattices and 
convex geometries, while Section 4 introduces the notion of capacity on a 
lattice, viewed as a set system. Section 5 gives the definition of entropy for 
such capacities on lattices, and studies its properties. Section 6 gives examples 
of different lattices, so as to recover well known cases. 



2 Entropy of classical capacity 

Throughout this paper, we consider a finite universal set A = {1,2, ... ,n}, 
and 2 N denotes the power set of A. Let us consider & a subcollection of 2 N . 
Then we call (A, &) (or simply & if no ambiguity occurs) a set system. In the 
following, (A, (3) or simply (3 will always denote a set system. 

Definition 1 (capacity) Let (A, 6) be a set system, with 0, A G 6. (i) A 
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game is a set function v : & — > R which satisfies v (0) = 0. (ii) A set function 
v : & — > [0, 1] is a capacity if it satisfies that v(0) = 0, v(N) = 1, and 
v(A) 5= v(B) whenever A C B. 

Usually classical games and capacities are defined on (JV, 2^) . 

Definition 2 (Shapley value) TTie Shapley value of a capacity v is defined 
by 

4>{v) := (0 1 (^),...,0 n (t;))G[O,l] n 

and 

Mv):= E ifa[v{Au{i})-v{A)], (2.1) 

ACA r \{i} 



where 



^ (n-k-m 



Remark that H" =1 <j>i(v) = 1 holds. 

Definition 3 (Shannon Entropy[19j) Let p,q be probability measures on 
(N,2 N ). The Shannon entropy of p and the relative entropy of p to q are 
defined by 



n 

i=i 

n 

Hsip; q) := E 



i=i 



where Pi := p({i}), q% '■= q({i}), h{x) := — xlogx, and h(x; y) := x\og ~. 

Here log denote the base 2 logarithm and by convention logO := 0. 

Definition 4 (Marichal's entropy[16j) Letv be a capacity on (N, 2 N ). Marichal's 
entropy of a capacity v is defined by 

n 

Hm(v):=Y1 £ ^ A] h[v(Au{i})-v(A)}, (2.3) 

i=l ACN\{i} 



where 7^ is defined by (12.21) . 

Remark that equations (12. ip and (12.31) are similar. Dukhovny gives a repre- 
sentation of Marichal's entropy using maximal chains of 2 N [B]. 



3 



Definition 5 (maximal chain of set system) Let (N, &) be a set system, 
with 0, N G &. If C — (c , Ci, . . . , c m ) satisfies that = c C c\ C • • • C c m = 
iV, Cj G (5 and i/iere zs no element c G (3 snc/i £/ia£ q_i C c C q /or any 
i G {1, . . . , m} then we call C a maximal chain of &. 

We denote the set of all maximal chains of & by C(&). Let v be a capacity on 
(3. Define p v,c by 

= (n(ci) - v(co),v(c 2 ) - v(d), . . . , v(c m ) - n(c m _i)), (2.4) 

where C = (co, ci, . . . , c m ) G C(&). Note that p 1 '' is a probability distribu- 
tion, i.e. pl ,C ^ 0,i = l,...,m and S^iPi' C ' = 1- Dukhovny showed that 
Marichal's entropy can be represented as an average of Shannon entropies of 
all probabilities p v > c such that C G C(2 N ): 

Hm{v) = ^ E H sip V ' C )- 

ceC(2 N ) 

Remark that \C{2 N )\ = n\. 



3 Lattices and related ordered structures 

In this section, we investigate the relations between lattices and set systems. 
In particular we introduce a general class of sets systems called regular set sys- 
tems, and also consider known classes of set systems called convex geometries 
and antimatroids. 

Definition 6 (lattice) Let (L, <) be a partially ordered set, i.e. < is a binary 
relation on L being reflexive, antisymmetric and transitive. (L, <) is called a 
lattice if for all x,y G L, the least upper bound iVt/ and the greatest lower 
bound x Ay of x and y exist. 

Let L be a lattice. If V S and A S exist for all SQL, then L is called 
a complete lattice. V L and A L ar e called the top element and the bottom 
element of L and written T and _L, respectively. We denote a complete lattice 
by (L, <, V, A, _L, T). If L is a finite set, then L is a complete lattice. 

The dual of a statement about lattices phrased in terms of V and A is obtained 
by interchanging V and A. If a statement about lattice is true, then the dual 
statement is also true. This fact is called the duality principle. 



4 



Definition 7 (V-irreducible element) An element x G (L, <) zs V -irreducible 
if for all a,b G L, x 7^ _L and x = a\/ b implies x = a or x = b. 

The dual of a V-irreducible element is called a A-irreducible element, which 
satisfies that if for all a, b G L, x ^ T and x = a Ab implies x = a or x = b. 
We denote the set of all V-irreducible elements of L by JiV) and the set of 
all A-irreducible elements of L by M.{L). 

The mapping rj for any a G L, defined by 

77(a) := G J"(L) I x < a} 

is a lattice-isomorphism of L onto r/(L) := {77(a) | a G L}, that is, (L, <) = 
(v(L), Q)- Obviously (J(L),r)(L)) is a set system (see Section 6.1). 

We say a is covered by 6, and write a -< 6 or 6 >- a, if a < b and a < x < b 
implies x — a. 

Definition 8 (maximal chain of lattice) C = (cq, c±, . . . , c m ) is a maxi- 
mal chain of (L, <) if Ci G L,i — 0, . . . ,m, and _L = c -< C\ -< ■ ■ ■ -< c m = T. 

We denote the set of all maximal chains of L by C(L). 

We introduce the regular property for set systems. 

Definition 9 (regular set system) Let (N, &) be a set system. We say that 
& is a regular set system if for any C G C{&), the length of C is n, i.e. 
\C\ =n + l. 

Definition 10 (V-minimal regular) If (L, <) satisfies that the length of 
C is \J{L)\, i.e. \C\ = \J(L)\ + I, for any C G C{L) then we say that 
(J(L),r]{L)) is V -minimal regular. 

Lemma 11 If (L, <) is V '-minimal regular then {J{L),r]{L)) is a regular set 
system. 

PROOF. Since r](L) is isomorphic to L, for any C G C(J(L)), \C\ = \J(L)\ + 
1 holds. 

Lemma 12 If L is V '-minimal regular, then for every maximal chains C = 
(c ,Ci, . . . ,c n ), where n = \ J{L)\, it holds that t/(q) = 77(^-1) U {j} for some 

jeJ(L). 

PROOF. It suffices to show that |t/(q)| = i. Suppose that there exists iq such 
that |n(cj )| > iq. Since |C| = n and \r)(cj) \ 77(0,-1) | ^ 1 for any i = 1, . . .n, 
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there will be not enough V-irreducible elements to complete the chain. 

Definition 13 (convex geometry and antimatroid) Let (N, &) be a set 

system. & is called a convex geometry of N if 

(i) 0,iVe 6, 

(ii) for any A,B G &, Af]B G &, 

(iii) for any A G & \ {N}, there exists i G N\A such that A U {i} G 6. 

Let (N, (3) be a convex geometry. The dual system of (N, &) defined by 21 = 
{iV \ A | A G &}, (N, 21) is called antimatroid. 

Following result can be found in [T7][18j. We give a proof for the sake of 
completeness. 

Lemma 14 // (N, &) is a convex geometry or an antimatroid, then & is a 
regular set system. 

PROOF. Let e be a convex geometry. Suppose that there exists C — (co, ci, . . . , c&) G 
C(&) such that |C| < n + 1. Then we can take q G C which satisfies 
|cj\cj-i| > 1. We have Cj_i C Cj C N, and by (iii) of Definition [T3| we can take 
ji, ...,j t G iV such that Cj_i U {jj, Cj_i U {ji, J 2 }, • • • , Q-i U {ji, . . .J t } G 6 
and q_i U {ji, . . . j t } = N, so that in these elements there exists an element c 
such that |c fl Cj| = |q| — 1. By (ii), c fl Cj G & and Cj_i C (c fl Cj) C Cj, which 
contradicts the fact that C is maximal. Hence \C\ ^ n+1. On the other hand, 
obviously, for any C G C(&), \C\ ^ n + 1, hence \C\ = n + 1. And by the 
duality principle, the antimatroid is also a regular set system. 

Convex geometries and antimatroids are complete lattices (&, C, V, n, N, 0) 
and (©, C, U, A, AT, 0), respectively, where x V y := f|{^ G (3 | x U y C z} and 
x Ay := \J{z G 6 | x D y C z}. 

Lemma 15 If (N,G) is a convex geometry, then \J~(&)\ = n. Similarly, if 
(N, &) is an antimatroid, then \A4(&)\ = n. 

PROOF. 

Suppose that © is a convex geometry. By Lemma dU for any a G 6, we 
have a \ a G N, where a -< a. And for any b, c G J~{&) such that b ^ c, we 
have b\b^c\c, because when b = c, we have b\b^ c\c obviously, and 
when bj^c, b\b = c\ c means b fl c D b \ b and b = (b D c) U b, which 
contradicts that b is a V-irreducible element, so that ^ ti. On the 

other hand, for any chain C = (c , . . . , c n ) G C(&), \f](ci)\ > \r)(ci-i)\ so that 
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n ^ |^(T)| = |J7"(<5)|. Therefore |i7((5)| = n. By the duality principle, the 
same is true for antimatroids. 



For example, &i in Fig. [T]is an antimatroid and a regular set system of iV 
{1,2,3}. \J(&i)\ = |{1, 3,12,23}| = 4 and |A*(©i)| = |{12, 13, 23}| = 3. 

N 



{1,2} {1,3} {2,3} 

{1} {3} 



©l 

Fig. 1. Antimatroid 

If 6 is a regular set system, it does not necessarily hold that |J7"(6)| = n nor 
|.M(©)| = n. Consider the lattice ©2 in Fig. [2j 62 is a regular set system of 
{1, 2, 3}, but J{&) =M{&) = {1, 3, 12, 23}. 

N 

{1,2} {2,3} 

{1} {3} 


62 

Fig. 2. Regular set system 

Remark A segment [a, b] of L, for a, b e L, is the set if all elements x 
which satisfy a < x < b. If & is a regular set system then & satisfies 
the Jordan- Dedekind chain condition, that is, all maximal chains in any seg- 
ments of & have the same length. The converse does not hold. For instance, 
(N,&) = ({1,2,3},{0, {l,2},{3},A r }) satisfies the Jordan-Dedekind chain 
condition but is not a regular set system. Incidentally, & is V-minimal regu- 
lar. Similarly, If L is a convex geometry or an antimatroid, then L satisfies the 
Jordan-Dedekind chain condition, but the converse does not hold. For instance, 
consider the lattice (6, C) = ({1, 2, 3, 4}, {0, {1}, {1, 2}, {3}, {3, 4}, N}) 
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4 Capacity on lattice 



Definition 16 (capacity on lattice) A mapping v : L — > [0, 1] is a capacity 
on L if it satisfies u(_L) = 0,v(T) = 1 and for any x,y G L, v(x) ^ v(y) 
whenever x < y. 

Definition 17 (cardinality-based capacity) A capacity on (N, &) is 
cardinality- based ifv(A) depends only on \A\ for any A G &. 

Definition 18 (additive uniform capacity) The additive uniform capac- 
ity on (N, &) is defined by 

v*(A) := M 
n 

for any A G &. 

Uniform capacities and the additive uniform capacity can be defined on any 
lattice L by putting \x\ := [77(07) | for any x G L. 

Faigle and Kern generalized the Shapley value to that of a game on a lattice [7J, 
and Bilbao defined it for games on convex geometries [3] and on antimatroids 

Definition 19 (Bilbao and Edelman's Shapley value) Let v be a game 
on a convex geometry or an antimatroid (N, &). Fori G iV, the Shapley value 
of v is defined by 

E (v(AU{z})-v(A)). (4.1) 



|C(©)| 

A,Au{i}eC 



When (5 is a regular set sytem of N, we can also define the Shapley value of 
games on & by (14.11) . 

By Lemma dU regarding the lattice as a set system of J7"(L), we can also 
calculate the Shapley value of capacities on the regular lattice as follows. 

Definition 20 (Shapley value on L (cf. JT])) Suppose that (L, <) is\l -minimal 
regular and let v be a capacity on L. For x G J(L), the Shapley value of v on 
L is defined by 



<f>x(v) 



\C(L)\ 



E 

cec(L) 



(v(Ci) - u(Ci_i)) 



8 



where C = (c , Ci, . . . , c n ) and n = \ J[L)\. 

By Lemma fT2| if L is V-minimal regular, for any C G C(L), 77(a) € <J{L) 

for any a, 6 G C such that a ~< b. Hence formulas H4.2[) are well-defined. 
Similarly, if L satisfies the following property: 

(A-minimal regular) any C G C(L), the length of C is |.M(X)|, i.e. |C| = 
|.M(L)|+1, 

for x G .M(X), we can calculate the Shapley value of capacities on L in a 
similar manner as follows. For x G A4(L), the Shapley value of v on L is 
defined by 



4>x( v ) '= T7T7TY\ ^ {v{Ci) - viCi.i)) 



v,G 



cec(L) 

?) d (c i _ 1 )\r l d (c i ) = a 



where C = (c , ci, . . . , c n ), n = |.M(L)| and r] d (a) := {x e M(L) \x> a}. We 
have (L,<) = (M(L),r] d (L)). 

If L is both V and A-minimal regular, then we can use both J{L) and Ai(L) 
for calculating the Shapley value. However J{V) is better, because elements 
of J{L) are in general easier to interpret (cf. Section RT5"]) . 



5 Entropy of capacities on lattices and set systems 



In this section, we suppose that (N, &) is a regular set system and let v and 
u be capacities on (N, &). 

Definition 21 (entropy) Let v be a capacity on &. The entropy of v is de- 
fined by 



H{v):= \c(vV\ £ h s(p v '% (5-13 



where C = (c , Ci, . . . , c n ). 
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Definition 22 (relative entropy) Let v and u be capacities on &. The rel- 
ative entropy of v to u is defined by 



H M:=-}— £ H s (p v ' c ;p u > c ). (5.2) 
l C ( 6 )lc eC( e) 



Let v and u be capacities on L. If L is V or A-minimal regular, then regarding L 
as a set system (J(L),r)(L)) or (Ai(L), rj d (L)), we can also define the entropy 
H(v) and the relative entropy H(v;u) as follows. 



H W'=Wn\ £ ^' C) ' (5 - 3) 

^(«;«):=— E Hs(p^ c ;p u ' c ). (5.4) 



We can consider that H(y) is an average of Shannon entropies, and also that 
H{u\ v) is an average of Shannon relative entropies. Therefore they satisfy 
several properties which are required for entropies (cf. |12j). 

Proposition 23 For any v, H(v) is a continuous function, and ^ H(v) ^ 
logn, with equality on left side if and only if v is {0, l}-valued capacity, and 
with equality on right side if and only if v is the additive uniform capacity v* . 



PROOF. The continuity is obvious. For any probability p, Hs{p) ^ 0, so 
that H{y) ^ holds. Hs(p) = if and only if p is deterministic, i.e. there 
exists i such that Pi — 1 and otherwise pj = 0. Hence for all C G C(&), p^' C 
takes value only or 1, which means that for all A 6 (3, v(A) takes value only 
or 1. Similarly, Hsip) ^ logn, so that an average of Hs(p) is dominated by 
logn. Hs{p) — logn if and only if for all i, pi = 1/n, hence for all a G &, 
v(A) = \A\/n, which completes the proof. 

Proposition 24 For any uniform capacity v on &, we have 

H(v) = H s (p v > c ) 

for any C G C(&). 



PROOF. In this case, for all C G C(&), p v ' is the same probability distri- 
bution, hence we have 
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H(v) 



\c(e)\ 



\C(6)\ 



E H s(P v ' C ) 



cec(&) 



C(6)| H s (p v > c ) = H s (p v ' u ). 



v,C\ 



Define V\ := (1 - X)v + \v* for < A < 1. Then for any v*), H(v\) is 
strictly increasing toward the additive uniform capacity v*. 

Proposition 25 For any v*), H{v\) is a strictly increasing function 
ofX. 



PROOF. We show that ^ '- > for any C G C(6) such that p v ' c ^ 



P 



i=i 

n 



P v i° + x[--p 

n 



v,C 



i=i l 

where C = (c , . . . , c n ) and := - i>(cj_i). 



dH s (p 



i=l 



El^- 1 ) (i + iog(pr c ' + A(-- P : 



E(K--i)(io g ( P - + A(i- P - 



If 1/n ^ then 



Pi + M P 

n 



Pi 

n 



and otherwise, that is, 1/n < , we have 



Pi +A - - ft' e -p.. 



1 



v,C 



n 



n 



so that we have 



dH s {p, 



> E 

i:l/n~Zp v .' C 



1 „,C 
- - Pi 

n 



log - + 



E 

i:l/n<p' 



1 v.C 
- - Pi 

n 



log- 
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log -2 (- ~P V i' C ) = log - f 1 - J2p v i'° 
n i=1 \n ) n\ i=1 







Since v ^ v*, there exist at least an C G C(6) such that p 1 '' ^ p t '*' c ', therefore 

1 



is a strictly increasing function of A. 



Proposition 26 H{v; u) ^ and £/ia£ i?(i>; u) = if and only if v = u. 



PROOF. Non-negativity is obvious by H s (p; q) ^ 0. And H(v; u) — if 
and only if H s (p'"' c ;p u ' c ) = for all C G C(6), which is true if and only if 
pv,c = pu,c f or a jj ^ g C((3), which means v = u. 

Proposition 27 Lei v ^ u and := Xu + (1 — A)i>. T/ien H(v^;u) is a 
strictly decreasing function of A . 



PROOF. We show that 



dH s (jp v "< c ;p u > c ) 
dX 

for any C G C{&) such that p"^' c ^ p ufi '. 



< 



i=l Pi 

n 

Ei [\/ u,C v,C\ i u.C 
ft |A(fV ) ;p 



dH {p vt,C. p u, C) _ ( ^ ^ A(pr ,C _ p „, C) + p «,C 



dA 



(pr-pr) log- 



u,C 
Pi 



+ 1 ■ 



If ^ then 



u,C 



Pi 



Pi 



v,C 



v,C ' 



1 , 



Pi 
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and otherwise, that is, p^ ,c < p^ ,C 



\ i v.C v,C\ i v,C / v,C\ 

KPi -Pi )+Pi L Pi \ 

u,C I ' »,C ' 

Pi \ Pi J 



so that we have 



dH(p v ^ c ;p u ' c 

Cj \ K I ■ I .' . (. 



"tt < (Pi -Pi )+ 2^ \Pi -Pi ) 



EpT c -J2pT c ) = o 



u,C ■sr^ v,C\ 
i=l i=l 

Since v ^ u, there exists at least unC 6 such that p'"' c ' ^ p n > c ; therefore 

1 



is a strictly decreasing function of A. 



6 Examples 



In this section, we show several examples. Most games and capacities which 
appear in applications are particular capacities on regular set systems. 



6.1 Regular lattice 

Li in Fig. [3] is V-minimal regular, and is also isomorphic to a convex geometry. 
a {d,e,f} 

b c {d,e} {e,f} 

d e f {d} {e} {/} 

9 
Fig. 3. 
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In fact, J{Li) = {d,e,f}, and L\ is also represented by r]{L\). C{j]{L\)) = 
{(0, d, de, def), (0, e, de, def), (0, e, ef , def), (0, f, ef, def)}. Let v be a capacity on 
L\. Then the Shapley values and the entropy of v on L\ are as follows. 



<f>div) = ~(v(d) - v(g)) + -(«(&) - v{e)) + ^(v(a) - v(c)) 
<P e (v) = \{v{e) - v(g)) + I( V (6) - v(d)) + \{v{c) - «(/)) 
= ^ W) - v(g)) + \(v(c) - v(e)) + \{v{a) - v(b)) 



and 



H(v) = \h[v{d) - v(g)] + \h[v{b) - v{e)\ + ±h[v(a) - v(c)} 
+ \h[v{e) - v(g)} + i/i[ v (6) - v{d)} + ^^(c) - «(/)] 
+-%(/) - «07)] + i/i[«(c) - «(e)] + i/i[«(a) - v{b)\. 



6.2 Distributive lattice 



(L, <) is said to be distributive if it satisfies the distributive law, a A (6 V c) = 
(a A b) V (a A c) for any a,b,c G L. If (L, <) is distributive then (L, <) is also 
V and A-minimal regular. Remark that a regular set system, even the convex 
geometry and the antimatroid are not necessarily distributive (cf. Fig. 2, Fig. 
3). 



6.3 Capacity on 2 N (classical capacity) 

The classical capacity is a monotone function on the Boolean lattice 2^. 2^ is a 
distributive lattice and also a complemented lattice, i. e. for any A G 2^, there 
exists a complement B G 2 N such that A A B = _L = and A V B = T = N. 
For any capacity on 2^, (14. ip is equals to the Shapley value (12.11) . and our 
entropies 05. ip and (15.21) are equal to Marichal's entropy (12. 3p (cf. Section 2). 



6.4 Bi- capacity [8j|9] 



A bi-capacity is a monotone function on Q(N) := {(A, B) G 2 N x 2 N | A D 
£ = 0} which satisfies that u(0,JV) = -l,f(0,0) = and u(JV,0) = 1. 
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For any {A 1 ,A 2 ) i {B 1} B 2 ) G Q(N), (A 1 ,A 2 ) E (B h B 2 ) iff Ai C B 1 and 
A 2 D B 2 . Q(N) = 3 N . It can be shown that (Q(N), Q is a finite distributive 
lattice. Sup and inf are given by (Ai, A 2 ) V (B ly B 2 ) = (A 1 U Bi, A 2 fl 5 2 ) and 
(Ai, A 2 ) A (fii, S 2 ) = (A 1 n Si, A 2 U B 2 ), and we have 

J(Q(N)) = {(0, iV \ {^}), z G iV} U {({i}, iV \ {{}), i G iV}, 

where i & N . Normalizing v by t> ' : Q(iV) — ► [0, 1] such that 

/ 1 1 

we can regard v as a capacity on Q(N). Then, applying (14.21) and (15.31) . we 
have 

0+(V) :=<j>({i},N\ii})(v') 

= E 7|A|,|B|K(^UW,5)-t;'(A5)), 

ACiV\{i) 
BCN\(Au{i}) 



4>i W) :=0(0,7V\{i})K) 

= E 7fW| A)- v'(B,A U{<})) 



ACiV\{i} 
SCJV\(Au{i}) 



and 



^ («0 = E E tPambi (A [v'(A U {z}, 5) - v'(A, B)} 



i=l A<ZN\x t 

BCN\(Au{i}) 



+h[v'(B,A)-v'(B,Au{i})]) 



{n-k + e-iy. {n + k-ey.2 n ~ k - e J L/ . 

where 7 fc£ := — , and Ma; J := — xloga;. 

(2n)! 

and (pi mean positive and negative degrees of z's contribution to i>, respec- 
tively, hence the contribution of i to v is given by </>i(v) := 4>t( v ) + 4>i( v )- 
7^1 i B | is the rate of the number of chains which contain (A U and 
(A,'B). In fact, 



|{C G C(Q(N)) \ C 3 (AU {i}, B), (A, B)}\ 

_(n+\A\-\B\)\ (n - \A\ + \B\ - 1)\ 
~ (2!)H (2!)l fi l 

and |C(Q(iV))| = (2n)!/(2!) n . These Shapley values are different from those in 
0- 
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6.5 Multichoice game 



Multichoice games have been proposed by Hsiao and Raghavan [TT]. They have 
been proposed also independently in the context of capacities by Grabisch and 
Labreuche [TQ], under the name k-ary capacities. 

Let N := {0, 1, . . . .n} be a set of players, and let L :— L\ x • • • x L n , where 
(Li, <i) is a totally ordered set Li = {0,1, ... , £i} such that <j 1 • • • <i 
Each Li is the set of choices of player i. (L, <) is a regular lattice. For any 
(ai, a 2 , . . . , a n ), (b x , b 2 ,..., b n ) G L, (a u a 2 , . . . , a n ) < (h, b 2 , . . . , 6 n ) iff a* < t k 
for all i = 1, . . . , n. We have 

J(L) = {(0, . . . , 0, a,, 0, . . . , 0) | at G J (Li) = L t \ {0}} 

and \J(L)\ = Yh=i U- The lattice in Fig. @] is an example of a product lattice, 
which represents a 2-players game. Players 1 and 2 can choose among 3 and 

(2,3) 

(2,2) (1;3) 

(2 ' X) (0,3) 
(1,2) 

(1,1) (0,2) 

(1,0) (0,1) 

(0,0) 

Fig. 4. 2-players game 

4 choices. Let v be a capacity on L, that is, v(0, . . . , 0) =0, w(^i, . . . , £ n ) — 1 
and , for any a, b G L, u (a) ^ t>(&) whenever a < b. In this case, applying (14.21) 
and (15.31) . we have 



^i( v ) = 0(O,...,O,a I =j>O,O,...,O)(^) 

= E & J) (v(a,j)-v(a,j-l)) 



a£L/Li 

and 



H(v)=Y. E h[v(a,j)-v(a,j-l)} 

»6JV a€L/L z 

where L/Lj := L 1 x---xL,_ 1 xL i+1 x---xL n , (a, a*) := (a%, . . . , a^ x , a u a i+1 , . . . 
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L such that a G L/Li and czj G Lj, and 



/ " / P W / x^ n P \ 1 



\fc=l 



s a k ) J \'l2k=l a kj J2k=l a k 



and := — adogx. 



$ (v) represents the contribution of player i playing at level j compared to level 
j — 1, where j,j — 1 G J{Li) = \ {0}, hence player z's overall contribution 
is given by 

= E 

^(a,o,) . g ^ e ra ^ e q £ ^ e number of chains which contain (a, a») and (a, a* — 1). 
In fact, 

\{C G C(L) | C 3 (a, a,), (a, a,-l)}| = — - ^ 

(n fc= iK!))(ai - l)!/(ai!) n fc =i((4 - a fc )!) 

and |C(L)| = (ELi4)!/nLi(4!)- 

Regarding a bi-capacity in Section 16.41 as a special case of multichoice game 
such that n players and ii = 2 for all % which is fixed a value u'(0, 0) = 1/2, 
we obtain the same Shapley values and the entropy. 



7 Conclusion 



We have proposed a general definition of entropy for capacities defined on a 
large class of ordered structures we call regular set systems, which encompasses 
the original definition of Marichal for classical capacities. Regular set systems 
contain as particular important classes, distributive lattices, convex geome- 
tries and antimatroids. Hence our approach permits to define the entropy of 
multichoice games, also called fc-ary capacities. 
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